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This  technical  note  describes  the  development  of  an  instrummit  to  assess  performance  of 
Electronic  Warfare  Technicians  (EWs)  in  the  operation  of  the  AN/SL(^32.  This  instrument  can  be 
used  to  (1)  evaluate  the  effectiveness  of  various  training  interventions  and  (2)  identify  expert 
equipment  operators. 


J.  C.  McLACHLAN 
Director,  Training  Research  Department 


V 


Problem 


Summary 


Performance  problems  associated  with  the  operation  of  the  AN/SLQ-32  for  both  surveillance  of 
electronic  emitters  and  for  andship  missile  defense  have  been  reported,  but  there  is  no  existing 
individual  operator  assessment  instrument  in  the  fleet  to  identify/verify  the  performance  problems. 

Objective 

The  overall  objective  of  the  Surface  Combat  Operator  Training  (SURCOT)  project  is  to 
investigate  and  identify  training  interventions  to  improve  AN/SLQ-32  operator  skills;  specifically, 
to  reduce  operator  performance  degradation  over  time,  reduce  performance  variability,  increase 
operator  consistency  and  precision,  and  reduce  perceived  workload. 

The  objective  of  the  work  summarized  in  this  technical  note  was  to  develop  an  assessment 
instrument  for  AN/SLQ-32  operators  that  can  be  used  to  describe  operator  skills,  to  discriminate 
between  effective  and  ineffective  operator  performance,  and  to  measure  the  effects  of  the  training 
interventions  designed  to  improve  operator  performance. 

Approach 

An  initial  list  of  operator  skills  was  developed  based  on  review  of  training  documents,  fleet 
training  requirements,  occupational  standards,  and  fleet  Electronic  Warfare  (EW)  exercises. 
Additionally,  three  EW  Technicians  (EWs)  were  observed  using  an  AN/SLQ-32  Operational 
Training  Device  in  an  operational  scenario.  Based  on  these  inputs,  a  preliminary  assessment 
instrument  was  compiled  and  reviewed  by  fleet  evaluators.  This  instrument  was  used  and  revised 
during  pilot  tests  of  19  AN/SLQ-32  operators  from  ship  and  shore  commands. 

Results 

The  resulting  performance  assessment  instrument  assesses  performance  under  the  following 
four  primary  skill  areas:  Identify/Correlate  Emitters,  Communications,  Countermeasures,  and 
System  Operation. 

Conclusion 

The  performance  assessment  instrument  can  assess  AN/SLQ-32  operator  performance; 
specifically,  it  can  be  used  to  describe  operator  skills,  to  discriminate  between  effective  and 
ineffective  operator  performance,  and  to  measure  the  effects  of  training  interventions  designed  to 
improve  operator  performance. 

Applications 

This  performance  assessment  instrument  was  used  to  assess  the  impact  of  three  training 
interventions  on  AN/SLQ-32  operator  performance  and  to  discriminate  between  effective  and 
ineffective  operator  performance  in  order  to  identify  expert  operators. 
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Introduction 


Problein 

Apprentice  level  Electronic  Warfare  Technicians  (EWs)  are  responsible  for  operating  the 
AN/SLQ-32  as  part  of  thdr  watchstanding  duties.  Operators  are  slowo*  than  deoned  acceptable  in  the 
detection,  lecognititm,  and  evaluation  of  inteicepled  signals  using  the  AN/SLX>32.  which  degrades  a 
ship’s  overall  capability  to  evaluate  and  counter  threats.  Four  areas  contribute  to  operator 
problems:  (1 )  the  dilemma  between  the  ship’s  need  fcnr  hard,  detenninistic  data  and  the  probabilistic 
data  provided  by  the  AN/SLQ-32,  (2)  management  of  surges  in  operator  workload,  (3)  skill 
degradation  during  periods  of  inactivity,  and  (4)  lack  of  a  concise  and  accurate  “mind’s-eye”  view  of 
the  tactical  situation. 

Objective 

The  overall  objective  of  the  Surface  Combat  Operator  Training  (SURCOT)  project  is  to 
investigate  and  identify  trairung  interventions  to  improve  AN/SLQ-32  operator  skills;  specifically,  to 
reduce  operator  performance  degradation  over  time,  reduce  performance  variability,  increase 
operator  consistency  and  precision,  and  reduce  perceived  workload. 

The  objective  of  the  work  summarized  in  this  technical  note  was  to  develop  an  assessment 
instrument  for  AN/SLQ-32  operators  that  can  be  used  to  describe  operator  skills,  to  discriminate 
between  effective  and  ineffective  operator  performance,  and  to  measure  the  effects  of  the  training 
interventions  designed  to  improve  operator  performance. 

Background 

The  AN/SLQ-32  is  an  antiship  missile  defense  (ASMD)  electronic  detection  system  that  uses 
computer-aided  processing  for  automatic  and  instantaneous  identification  of  intercepted  signals.  Its 
primary  purpose  is  to  augment  ship  defense  against  antiship  cruise  missiles  and  other  weapons  of 
similar  radio  frequency  characteristics.  Its  sea)ndary  purpose  is  to  detect  and  identify 
electromagnetic  (EM)  emissions  within  the  ship’s  operation^  area.  It  is  typically  operated  by  the 
jurtior  EWs  aboard  ship,  while  senior  EWs  in  the  division  ate  responsible  for  supervisory  and 
coordinating  duties. 

There  is  currently  no  assessment  of  individual  AN/SL(^32  operator  performance.  While 
supervisor  ratings  may  be  available,  Vmeberg  and  Joyner  (1982)  note  that  the  correlations  between 
such  ratings  and  sample  tests  of  proficiency  have  been  low.  According  to  a  report^  of  the  Electronic 
Warfare  inter-fleet  working  group  (EWIWG),  there  is  a: 

Need  to  establish  [a]  standardized  and  effective  method  of  measuring  the  operational 
proficiency  of  EW  personnel.  Currently,  a  wide  variety  of  vehicles  are  available  to  test  EW 
operators.  In  fact,  the  volume  of  test  results  far  exceeds  our  ability  to  analyze  and  utilize  the 
results.  The  problem  is  further  exacerbated  by  the  fact  that  each  Fleet  uses  different  testing 
methods,  periodicity,  and  analysis  tools.  In  addition,  there  are  no  [^propriate]  measures  of 
effectiveness  in  use  upon  which  to  base  Navy-wide  skill  and  knowledge  measurement  (pp.  4-S) 

An  individual  multiple-choice  test  (ELW-24-SF)  admirustered  prior  to  Refresher  Training 
(REFTRA)  primarily  focuses  on  recognition  of  various  radars,  publications,  and  reporting  methods. 
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Additicmally,  Beet  Training  Groups  (FTGs)  conduct  assessmoits  of  the  performance  of  the  EW 
division  by  watch  section  prior  to  ship  (teployment  FTG  San  Diego,  for  example,  conducts  2  to  4 
weeks  of  REFTRA  for  the  crew  of  each  ship  r^proximately  every  18  months,  d^nding  (xi  rotation 
and  world  events.  They  employ  10  of  the  24  EW  exi^ises  (EWEXs)  available.  Instructors  from  FTG 
observe  shipboard  exercises  using  battle  scenarios  and  evaluate  group  performance.  The  performance 
evaluation  during  these  EWEXs  examines  preparation  of  the  EW  watch  section  for  watchstanding, 
signal  classification,  reporting  procedures,  employment  of  countermeasures,  and  infcamation  flow. 
After  REFTRA,  a  numeric  score  with  a  verbal  rating  summary  (e.g.,  outstanding,  satisfactory)  is 
forwarded  to  the  ship’s  commanding  officer  and  the  type  commander  (TYCOM).  Individual 
performance  is  not  noted  except  when  exceptionally  good  or  poor. 

Even  though  tte  REFTRA  exercises  evaluate  the  EW  division  aboard  ship  and  not  the  individual 
operator,  some  work  has  been  previously  accomplished  in  individual  EW  performance.  Past 
experimental  measures  of  EW  operator  elTectiveness  include  both  time  and  accuracy  of  emitter 
(radar)  identification,  and  correlation  (matching)  of  those  radars  with  their  associated  platforms. 
However,  the  measures  were  restricted  to  only  one  of  the  many  operator  tasks  and  were  conducted 
with  limited  simulation  capabilities. 

Guidelines  for  the  evaluation  of  individual  performance  of  other  Combat  Information  Center 
(CIC)  operator  watchstanders  have  been  established  in  the  past  Mackie,  Ridihalgh,  Seltzer,  and 
Shultz  (1981)  stated  that  any  test  of  individual  sonar  operator  performance  must  be  as  opo'ationally 
realistic  and  as  comprehensive  as  possible;  that  is,  it  must  measure  each  major  element  of  op^tcM’ 
performance,  such  as  search  procedure,  target  detection  and  reporting,  target  tracking  and 
localization,  and  taiget  classification.  Their  guidelines  agree  with  those  presented  by  Grodsky  ( 1967) 
and  by  Alluisi  (1969)  (see  Appendix  A)  in  terms  of  their  applicability  to  ^11  performance 
assessment 


Approach 

An  individual  performance  assessment  instrument  must  encompass  the  range  of  tasks  required  of 
the  watchstander.  For  the  AN/SLQ-32  operator,  it  must  be  sensitive  to  his  propensity  to  consult 
references  (such  as  the  Electronic  Order  of  Battle  [EOB]  and  messages),  the  types  and  frequency  of 
use  of  the  Fixed  Action  Buttons  (FABs)  on  the  console,  the  number  and  types  of  detected  emitters 
acted  upon,  opoator  initiated  reports  (disseminating  information)  to  the  battle  group’s  EW 
information  coordinator  (Alpha  Echo  [AE])  and  to  the  Tactical  Action  Officer  (TAO)  on  board 
ownship,  responses  to  requests  for  information  from  AE  and  TAO,  and  operator  initiated 
countermeasures  to  high-threat  emitters. 

Identify  Skills  of  Interest 

Training  documents,  fleet  training  requirements,  and  occupational  standards  (including  the 
AN/SLQ-32  (V)  Countermeasures  Set  Operator  Training,  Software  User's  Manual,  1991;  EW 
Continuum  Training  Plan,  1990; ;  EW  Operator  Training:  Topic  Learning  Objectives,  1990;  and 
Navy  Enlisted  OCCSTDs,  EW,  1993)  were  reviewed  to  produce  a  preliminary  list  of  skills  and 
Measures  of  Performance  (MOPs).  This  list  was  sent  to  subject  matter  experts  (SMEs)  for  review  and 
ctnnment  Table  1  lists  the  revised  skill  areas  and  skills.  The  criticality  of  the  skill  areas  to  operator 
performance  was  inferred  by  determining  their  relative  importance  in  the  scoring  criteria  used  in  the 
FTO-conducted  EWEXs.  For  example,  skills  associated  with  the  identification  and  correlation  of 
emitters  are  most  highly  weighted  in  the  EWEXs  because  they  are  considered  to  be  the  most  critical 
skills. 
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T^blel 


PreKminary  List  of  Operator  Skills 


Skill  Area/Skill 

Can  be  Evahiaied 
Under  Controlled 
(Conditions? 

Identify/Conelate  Emitters 

Preparation  for  Watdistanding 

IdoD^  deciranic-wai6ie  support  measure  (ESM)  leodver  types  by  operating  cfaatacteristics. 
Memorize  selected  emitter  d^. 

Use  EWdocuments  and  publications  to  extract  needed  information. 

Prqiare  an  Electronic  Order  of  Battle  (EOB). 

Partially 

Integrate  Infarmatlon 

Acquire  and  fuse  data  Crcm  many  sources. 

De^op  a  mental  picture  of  the  aii/surface/land  tactical  situation. 

Identify  changes  in  tactical  situation. 

Correlate  ESM  intercepts  with  onboard  sensors 

Correlate  ESM  intercepts  with  offboard  sensors. 

Correlate  ESM  intercqits  with  intelligence. 

Partially 

Measnre  PatanMters 

Perform  mathematical  formula  oonverskm  imd  conputations  on  selected  ESM  signal  parameter 
data. 

Determine  radar  parameters. 

Perform  basic  scan  recognition  and  measurement  by  audk)  indications. 

Perform  basic  scan  recognition  and  measurement  by  visual  indications. 

Perform  comidex  scan  recognition  and  measurement. 

Triangulate  contaa  positions  using  ESM  bearings. 

Yes 

Classify  Emitters 

Perform  EW  signal  evaluation  utilizing  R^iid  Evaluation. 

Identify  and  cmelale  an  intercepted  emitter  using  an  EOB. 

Identify  and  correlate  specific  emitters. 

Instantaneously  identify  high-threat  emitters. 

Determine  emitters  that  are  exhibiting  a  War  Time  Reserve  Mode  (WARM). 

Yes 

Communications 

Extract  Infomiation 

Extract  informatioo  fnmi  EW  message  trafiSc. 

htterpret  information  provided  by  Naval  Space  Surveillance  (NAVSPASUR)  messages. 

Partially 

Dbscminate  Infomuitlon 

Log  EW  signals  of  interest 

Report  internal  EW  information. 

Rqxxt  external  EW  information. 

biitiate  a  Meaconing,  Intrusions,  Jamming,  Interferem^  (MUI)  report  by  completing  an  MUI 
Feeder  rqiort 

Plot  EW  information. 

Demonstrate  ability  to  tectmunend^iafcMm  the  apimqxiate  action  in  an  antiship  missile  defense 
(ASMD)  environment 

Brief  watch  relief  on  force  disposition. 

Brirf  watch  relief  on  active  emission  summary. 

Brief  watch  relief  on  threat  environment 

Partially 
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Table  1  (Continue) 


SkUl  Area/SkiU 

Can  be  Evahiaied 
Under  CtntraUed 
Conditirms? 

Coumenneasures 

Aaactt  SituatloB 

Assess  tactical  situation  to  determine  impact  on  emission  conmd  (EMCCH4)  posture. 

Yes 

Initiate  ComUermeasiircs 

Perfonn  tbe  appropriate  action  in  an  ASMD  environmenL 

Execute  pro-plann^  le^mnses. 

Recomineiid  use  of  chaff  and  infrared  GR)  countermeasures. 

Recommend  use  of  offboard  active  decoy. 

Engage  targeting  emiaers  with  oountertargeting  active  eieciranic  oountenneasures  (AECM). 

Perfonn  AECM  engagemoit  of  detected  threats  (Le..  missiles). 

Evaluate  the  effectiveness  of  either  the  onboard  AECM.  offboard  decoys,  or  both. 

Yes 

System  Operation 

Operation 

Recognize  and  interpret  all  indkations  occurring  during  the  setup  and  perfmnance  of  the 
tolerating  procedures  and  perform  spptopaate  opetasor  actions  in  the  prroier  sequence  on  the 
AN/SLQ-32. 

Recognize  and  inteqiiet  all  indications  occurring  during  the  sehip  and  performance  of  the 
operatmg  procedures  and  perform  appropriate  operator  actions  in  the  pnoier  sequence  on  the 
MK36  Deroy  Launching  System. 

Perform  tasks  in  the  casualty/degraded  modes  of  operation  for  tbe  Display  Processm  Group. 

Partially 

Programming 

Construct  an  automated  emitter  library. 

Yes 

The  skill  areas  in  which  performance  can  be  measured  under  conuroUed  laboratory  conditions 
were  then  identified.  The  conditions  for  performance  assessment  must  be  control!^  to  reduce 
confounding  variables  while  maintaining  fidelity  to  actual  shipboard  operations.  For  example,  in 
the  laboratory,  the  operator  may  report  orally  to  AE  and  the  TAO  the  classification  of  detected 
emitters  from  hostile  platforms  in  the  operational  scenario,  which  is  similar  to  the  reporting 
requirement  aboard  ship  during  actual  watchstanding.  Such  tasks  are  identified  in  Table  1  as  w'^.d. 
However,  several  components  of  a  skill  area  may  not  be  replicated  for  assessment  in  the  lab,  and 
so  caimot  be  evaluated  exclusively  under  laboratory  conditions.  These  must  somehow  be 
augmented  by  other  measures.  For  these  skill  areas,  the  response  to  the  question  “Can  [the  .skill 
area]  be  evaluated  under  controlled  conditions?”  is  listed  as  “partially”  in  Table  1. 

Procedure 

An  Operational  Training  Device  (OTD)  using  the  same  software  load  currently  used  in  the  fleet 
was  used  for  the  operator  performance  assessments  at  NPR£)C.  The  OTD  has  high  physical  and 
audio  fidelity  to  the  AN/SLQ-32  Display  and  Control  Console.  It  provides  all  operator  function  and 
display  capabilities,  has  limited  signal  select  capability  to  produce  realistic  audio  signals,  and  is 
csq)able  of  interfacing  with  external  devices  for  transfer  of  scenario  event  data.  The  performance 
assessment  instrument  was  used  with  an  operational  scenario  based  on  one  currently  used  by  the 
fleet  to  ensure  tactical  soundness  and  face  validity.  The  scenario  was  modified  to  (1)  provide  a 
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certain  level  of  ambiguity  in  the  automatic  classification  of  detected  emitters,  (2)  provide  variations 
in  workload,  and  (3)  be  of  sufficient  duration  to  permit  assessment  of  the  operator’s  development 
of  a  “mind’s  eye  view”  of  the  tactical  situation. 

Materials  and  references  (such  as  friendly  and  threat  EOBs,  a  maneuvering  board  [moboard] 
depiction  of  own  force  disposition,  intelligence  messages,  and  logkeeping  sheets)  normally 
available  to  the  operator  aboard  ship  were  supplied  to  the  operator/subject  Two  E-Ss  from  the 
Navy  EW  Training  Aid  Program  (NEWTAP)  served  as  AE  and  ownship  TAO  to  provide  subj^ts 
with  the  opportunity  to  gather  information  and  disseminate  reports.  The  acting  AE  and  TAO  were 
provided  with  scenario  summaries,  watch  prebrief,  a  table  of  scenario  events  (with  library 
classifications  of  emitters),  expected  reports,  and  polar  displays  at  S-minute  interval. 

While  standing  watch  at  the  OTD,  the  operator  encountered  emitters  which  the  software 
automatically  classified.  The  surveillance  portion  of  the  watchstanding  task  involved  the  operator 
identifying  (naming)  the  emitter  based  on  either  his  memory  or  the  references  supplied.  The 
operator  was  required  to  report  hostile  and  commercial  emitters  and  log  reports.  As  the  scenario 
developed,  the  operator  was  to  counter  missiles  appropriately  (using  either  active  and/or  passive 
resources)  and  make  tactical  recommendations. 

The  impact  of  changes  in  workload  on  operator  performance  was  evaluated  in  several  ways. 
The  main  library,  preloaded  into  the  OTD,  contains  parametric  data  for  automatic  classification  of 
emitters.  However,  at  times,  this  classification  may  be  incorrect,  be  displayed  as  an  unknown,  or 
be  applicable  to  more  than  one  radar.  Also,  the  number  of  new  emitters  presented  to  the  operator 
varies  with  time.  For  example,  between  3  and  4  minutes  into  the  scenario,  six  new  emitters  are 
acquired.  During  other  1-minute  intervals,  however,  no  new  emitters  are  acquired.  The  frequency 
with  which  emitters  become  inactive  also  varies  with  time.  These  events  also  can  be  considered 
minor  contributors  to  workload,  since  the  operator  must  address  and  respond  to  such  events. 
Finally,  screen  clutter,  which  also  contributes  to  workload,  may  result  from  multiple  symbols  of  the 
same  emitter  displayed  under  some  conditions,  multiple  emitters  occurring  on  the  same  bearing, 
and  failure  of  the  operator  to  “clear”  inactive  emitters. 

Operator  actions  and  verbal  reports  were  videotaped  (using  a  quad  screen  to  capture  views  of 
the  display  screen,  the  operator,  and  the  OTD  keyboard).  All  interactions  with  the  software  (i.e., 
FAB  and  keyboard  presses)  were  recorded  and  time-stamped  by  Comptek’s  Data  Extraction  (DX) 
device.^  Relevant  data  from  DX  printouts  and  videotapes  for  each  operator  were  used  to  answer 
the  questions  posed  in  the  performance  assessment  instrument. 

Prelinninary  Performance  Assessment  Instrument 

In  a  pilot  test,  the  performance  of  three  EWs  was  videotaped,  analyzed,  and  transcribed  to 
determine  what  actions  AN/SL(^32  operators  did  or  did  not  do  in  classifying  and  reporting  radars 
and  countering  missiles.  Most  of  the  specific  assessments  and  checks  made  during  REFTRA 
EWEXs,  supplemented  by  the  observations  made  in  comparing  operator  performance  in  the  pilot 
test,  were  incorporated  into  a  list  of  candidate  measures.  These  checks  were  defined  in  terms  of 
tteir  significance  (i.e.,  why  they  were  considered  important  as  performance  measures),  occasions 


^Identification  of  specific  equipment  is  for  documentation  only  and  does  not  imply  endorsemenL 
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or  events  within  the  scenario  in  which  they  could  be  observed  or  expected  to  occur,  associated  skill 
areas  (from  Table  1),  and  sources  from  which  data  could  be  collected  (i.e.,  videotape  or  direct 
recording  of  all  button  and  keyboard  presses  through  the  use  of  the  DX  unit).  The  result  was 
reviewed  and  annotated  by  three  senior  EW  evaluators  at  FTG  San  Diego  for  relevance 
(appropriateness  of  the  measure)  and  relative  importance  (to  ensure  that  more  important  items 
would  be  more  heavily  weighted  in  the  scoring  scheme).  This  first  round  of  review  resulted  in 
additional  checks  (e.g.,  ‘To  whom  does  the  operator  first  report?”)  being  incorporated,  and 
construction  of  a  scoring  scheme  or  weighting  for  relevant  items. 

Minor  revisions  to  the  assessment  instrument  were  made  throughout  subsequent  operator 
testing.  The  revisions  were  based  on  additional  SME  comments  (from  FTG  and  NEWTAP), 
observations  or  “lessons  learned”  (e.g.,  strategies  used  to  clear  the  outer  ring  of  the  display;  chaff 
launching  procedures),  and  minor  edits  to  the  scenario. 

Subjects 

Three  EWs  (two  from  NEWTAP,  one  from  Fleet  Combat  Training  Center,  Pacific)  operated  the 
OTD  as  a  pilot  test  of  the  laboratory  conditions.  Subsequently,  the  performance  of  19  subjects  was 
assessed  using  the  OTD  (between  10  February  and  26  March  1992).  Of  the  19  subjects,  17  were 
from  ships  and  two  were  from  shore  commands.  Tbe  majority  of  ship-based  subjects  were  from 
cruisers  (N  =  10),  the  subjects’  average  rate  was  E-4,  and  all  subjects  had  AN/SL(^32  operational 
experience. 


Results  and  Discussion 

Performance  Assessment  Instrument 

The  performance  assessment  instrument  (Appendix  B)  assesses  performance  under  the 
following  four  primary  skill  areas:  Identify/Correlate  Emitters,  Communications,  Countermeasures, 
and  System  Operation.  The  instrument  is  structured  to  answer  specific  performance  questions, 
primarily  with  a  yes  or  no.  Since  the  behavior  in  qi^tion  may  be  applicable  to  more  than  one  event 
in  the  scenario,  all  relevant  events  occurring  in  the  scenario  to  which  the  question  could  apply  are 
listed.  A  statement  indicating  the  significance  of  the  item  is  also  provided  (i.e.,  why  the  item  should 
be  included  as  a  performance  measure).  The  item  “related  MOPs”  provides  a  reference  to  the  initial 
skill  list  The  source  from  which  relevant  data  can  be  acquired  also  is  listed.  Finally,  a  total  possible 
score,  or  weighting,  based  on  FTG  input  of  the  item’s  criticality,  along  with  directions  for  scoring, 
is  provided  for  each  item. 

The  AN/SL(^32  operator  relies  heavily  on  cognitive  skills;  that  is,  those  skills  in  which  the 
adequacy  of  ^rformance  can  only  be  inferred  from  an  observable  event  such  as  an  overt  action  or 
report  For  example,  recognition  of  a  radar  emitter  as  a  friend  can  be  inferred  either  by  the  absence 
of  an  operator  report  (since  only  hostile  emitters  are  reported)  or  the  operator  correcting  the 
displayed  symbology  if  it  is  automatically  classified  as  a  nonfriend  (i.e.,  hostile  or  unknown).  This 
m^ces  documenting  the  performance  difficult 
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Application 

Li  looking  at  the  performance  of  the  initial  group  of  19  operators,  some  operators  performed  at  a 
higher  skill  level  than  did  others.  Overall,  the  composite  score  on  the  performance  assessment 
checklist  was  used  to  assess  relative  competence.  Paygrade  was  slightly  correlated  with  performance 
assessment  When  the  scores  of  the  two  senior  supervisors  (E-6s)  were  eliminated,  paygrade  was 
more  highly  correlated  with  the  performance  assessment  Since  many  of  the  skills  associated  with 
operation  of  the  AN/SLQ-32  are  considered  perishable,  lower  scores  at  the  highest  paygrade  were  to 
be  expected  because  personnel  rated  E-6  and  above  rarely  operate  the  AN/SLQ-32. 

The  performance  scores  were  also  used  to  identify  and  quantify  (1)  expert/novice  differences 
and  (2)  overall  performance  deficiencies.  For  example,  high  scoring  operators  reported  most  of  the 
hostile  emitters  and  did  not  report  any  friends  that  were  misclassified  as  hostiles,  they  changed 
misclassified  hostile  emitters  to  the  correct  platform  symbology,  they  listened  to  the  audio 
presentation  of  the  emitter  frequently,  they  gave  an  emergency  report  on  fire  control  radars  before 
missile  launch,  they  reported  all  detected  missiles  quickly  (including  the  composition  of  multiple 
missile  launches),  and  they  recalled  the  locations  of  most  platforms  and  emitter  activity  at  the 
conclusion  of  the  scenario.  This  may  be  compared  with  the  performance  of  those  who  scored  much 
lower. 

The  low-scoring  group  reported  only  half  of  the  possible  hostile  emitters  while  reporting  a  few 
friends  misclassified  as  hostiles,  they  never  changed  misclassified  friendly  or  hostile  emitters  to  the 
correct  platform  symbology,  they  did  not  listen  to  the  audio  signal,  they  gave  no  emergency  report 
on  fire  control  radars,  they  reported  an  average  of  two  of  the  three  possible  missiles  (but  no 
composition  information)  far  beyond  the  fleet  time  standard,  and  they  recalled  locations  of  only 
two  of  five  selected  platforms  at  the  conclusion  of  the  scenario.  Three  of  the  low-scoring  operators 
unsuccessfully  hunched  chaff  after  missiles  went  inactive. 


Conclusions 

The  performance  assessment  instrument  can  assess  AN/SLQ-32  operator  performance; 
specifically,  it  can  be  used  to  describe  operator  skills  to  discriminate  between  effective  and 
ineffective  operator  performance,  and  to  measure  the  effects  of  training  interventions  designed  to 
improve  operator  performance. 


Applications 

This  performance  assessment  instrument  was  used  to  assess  the  impact  of  three  training 
interventions  on  AN/SLQ-32  operator  performance  and  to  discriminate  between  effective  and 
ineffective  operator  performance  in  order  to  identify  expert  operators. 
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Appendix  A 

Considerations  for  Individual  Performance  Assessment 
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Considerations  for  Individual  Performance  Assessment^ 


1.  Content  validity. 

2.  Constnict  validity. 

3.  Face  validity,  operator  acceptance. 


4.  Sensitivity. 


S.  Engineering  feasibility. 


6.  Task  reliability. 

7.  Hexibility. 

8.  Workload  variability. 

9.  Trainability. 


10.  Control-data  availability. 


Tasks  appear  to  include  desired  content 

Tasks  appear  to  measure  die  desired  functions  oithogonalty. 

Test  batieiy  must  appear  to  die  operator  to  measure 
important  a^iects  of  pofoimance;  othowise,  performance 
may  r^lect  fluctuations  in  qietator  inioest  and  modvadon 
that  are  indqiendent  of  the  parameters  under  study. 

Tasks  must  reflect  genuine  performance  changes  that 
occur  under  the  condidons  of  study.  The  task  must 
reflect  appropriate  changes  created  by  relevant 
experimental  condidons. 

Equipment  and  software  must  be  within  design 
capabilides  and  be  available  at  reasonable  cost  and 
without  major  delay.  Equipment  must  be  sufficiendy 
reliable  to  permit  sustained  use. 

Each  task  must  demonstrate  high  statisdcal  reliability. 

Test  battery  must  be  easy  to  modify  in  terms  of  stimuli 
programming  and  response  recording. 

Test  battery  must  contain  a  range  of  workloads  and 
must  include  both  realisdc  loadings  of  the  operator  and 
demand  for  dmesharing  among  the  tasks. 

“Learning"  in  the  operadonal  situadon  should  not  be  a 
major  variable  in  the  tasks  selected;  the  operator  is  not 
expected  to  learn  to  perform  the  funcdons  during  the 
mission. 

Tasks  must  be  adaptable  to  laboratory  invesdgadons; 
where  differences  in  performance  are  obtained  with 
different  samples  of  subjects,  the  differences  must  be 
specifiable  and  able  to  be  related  to  expected  results 
with  other  populadons. 


^Adapted  firom  AOuisi  (1969),  pp.  94-96. 
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Appendix  B 

AN/SLQ-32  Operator 
Performance  Assessment  Instrument 


Note.  The  statements  labeled.  Significance,  are  included  to  ensure  that  all 
raters  maintain  the  same  assessment  perspective  when  using  this  instrument 
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AN/SLQ-32  OPERATOR  PERFORMANCE  ASSESSMENT  INSTRUMENT 


Operator  _ 
Date  J 
DX  Check 
VT  Check 

-  IDENTIFY/CORRELATE  EMITTERS  • 

1.  Does  the  operator  report  HOSTILE  emitters  accurately?  (Y/N) 


If"N" 

a.  Emitters  which  are  easier  (the  OTD  classifies  correctly): 

What  Was 

Actually 

Platform 

Radar 

Time  Up 

Brg 

Y/N 

Repomsd? 

(1) 

S17 

DONE 

3:41 

048 

(2) 

S16 

OWLSCH 

21:38 

356 

(3) 

A30/A31 

SSN2CMH 

22:53 

000 

_ 

(4) 

A15-17* 

DWNBEAT 

25:22 

293 

(5) 

A26-29* 

SHRTHRN 

28:00 

040  start 

(6) 

A55/A56* 

SSN-19 

30:30 

080  start 

(7) 

A42/A43* 

AS4MH 

33:09 

120 

_ 

_ 

(8) 

A38/A39* 

AS4MH 

34:31 

294 

1f"N", 

b.  Emitters  which  are  more  difficult: 

What  Was 

Actually 

Platform 

Radar 

Displayed* 

Time  Up 

Brg 

Y/N 

Reported? 

(1) 

S16 

PLMFND 

SNPPLT 

3:15 

000 

(2) 

S16 

PEELGRP 

GENMSL 

4:34 

000 

(3) 

All* 

BBULGB 

GENMSL 

17:49 

345 

(4) 

S16* 

PEELGRP 

UNKorMSL 

22:07 

356 

(5) 

S29 

SNPTRl 

TOPBOW+2 

22:14 

029 

(6) 

A19-22 

PUFFBALL 

UNK 

33:35  278?  start 

(7) 

A44-46 

AS-2 

SSN2/AS2 

35:00  122?  start 

_ 

*One 

or  more  don't  come  up  consistently 

Significance:  This  item  (#1)  and  #9  seem  to  be  the  primary  evaluation  checks  of  operator 
proficiency  in  terms  of  evaluating  emitters.  It  would  be  interesting  to  see  if 
emitters  which  are  classified  by  the  SLQ  correctly  are  more  often  rqxnted 
conectly  than  those  that  are  classified  incorrectly  by  the  SLQ  (i.e.,  does  the 
q)erator  believe  the  SLQ's  classification?) 


RELATED  MOPs:  11, 14, 16, 17 
DATA  SOURCE;  VIDEOTAPE 

SCORE: _ /30  (1  Point  for  Report  but  Incorrect,  2  Pts  for  Report  and  Correct) 


2.  Does  operatot  accept  incorrect  classifications  of  friendlies  frxxn  the  OTD?  (Y/N) 


Platform 

Radar 

Symbology 

DispUved 

TimcUo 

Brg 

Y/N 

LD. 

Reported 

(1) 

S2 

SPS-49 

HOS  SUR 

various 

219 

(2) 

S5 

SPS-49 

HOS  SUR 

various 

080 

(3) 

S4 

LN-66 

UNK 

3:00 

260 

_ 

(4) 

A5 

APG-65 

UNK 

3:30 

020 

(5) 

S2 

MK-92 

MSL 

4:15/26:12 

219 

(6) 

AlO 

RDR-IE 

UNK 

6:30 

220 

(7) 

S7 

SPG-55B 

UNK 

16:35 

039 

_ 

(8) 

S18 

Marconi 

HOS  SUR 

17.-09 

249 

(9) 

S6 

SPG-60 

UNK 

18:00 

129 

(10) 

S6 

SPQ-9 

UNK 

18:01 

129 

_ 

(11) 

S3 

SPG-51 

UNK 

24:40 

309 

_ 

(12) 

S12 

SPS-40 

UNK 

various 

355 

(13) 

S28 

DECCA40 

UNK 

36:23 

320 

(14) 

S7 

SPS-fi7 

UNK 

45:48 

038 

Sifnificance:  In  the  scenario,  the  OTD  classifies  emitrers  from  some  friendly  platfonns  as  HOS 
SUR.  If  the  operattx'  gives  a  racket  report  on  these  emitters,  it  indicates  that  he 
is  using  the  automated  library  as  his  prunary,  if  not  only,  source  of  information 
for  classifying  the  emitters. 

RELATED  MOPh:  10, 11,  14 

DATA  SOURCE;  VIDEOTAPE 

SCORE: _ 

(-2  Points  for  each  Incorrect  Report) 
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3.  Does  the  operator  redesignate  FND  onitters  whidi  come  as  UNK  or  HOS  using  either  tte 
DESIGNATE  ID  or  the  ENTRY  FABs?  (Y/N) 


Platfomi 

Symbology 

PiSBigYS4 

TimcUo 

Brg 

Y/N 

ENTRY  or 
DESIG  ID? 

(1) 

S2 

SPS-49 

HOSSUR 

various 

219 

(2) 

S5 

SPS-49 

HOS  SUR 

various 

080 

(3) 

S4 

LN-66 

UNK 

3K)0 

260 

(4) 

A5 

APG-65 

UNK 

3:30 

020 

(5) 

S2 

MK-92 

MSL 

4:15/26:12 

219 

(6) 

AlO 

RDR-IE 

UNK 

6:30 

220 

(7) 

S7 

SPG-55B 

UNK 

16:35 

039 

(8) 

S18 

Marami 

HOS  SUR 

17.-09 

249 

(9) 

S6 

SPG-60 

UNK 

ISKX) 

129 

(10) 

S6 

SP<}-9 

UNK 

18K)1 

129 

(11) 

S3 

SPG-51 

UNK 

24:40 

309 

(12) 

S12 

SPS-40 

UNK 

various 

355 

(13) 

S28 

DE<XA40 

UNK 

36:23 

320 

(14) 

S7 

SPS-67 

UNK 

45:48 

038 

Significance:  This  indicates  the  operator  has  (xnrectly  classified  emitters  as  finendly,  and/or 
maintains  the  SLQ-32  polar  display  over  time.  The  DESIGNATE  ID  functimi 
provides  a  quick  method  to  i^signate  an  emitter  as  a  generic  HOS/SUR 
SUB/AIR/SUR  or  MSL  platfomL  ENTRY  (with  a  menu  selection  of  "S")  is  a 
nxne  precise  method  to  designate  an  emitter  with  a  particular  name^latform. 

RELATED  MOFis:  7.  11.  14 

DATA  SOURCE:  DX  UNIT/ VIDEOTAPE 

SCORE: _ / 14  NOIE:  Stxnetimes  dwse  are  classified  conectly  by  die  OTD/libraiy. 

(1  Pdnt  for  each  Redesignate) 


4.  Does  the  operator  rnlesigiiate  HOS  emitters  which  are  incOTrectly  di^layed  as  otfier 
platforms  using  the  DESIGNATE  ID  or  ENTRY  FABs?  (Y/N) 


PlatfOTm 

Symbology 

Time  Up  Irg 

Y/N 

(1) 

S16 

PLMFND 

SNPPLT 

3:15 

000 

(2) 

A7* 

BBULGA 

BBULGB 

4.*01 

045 

(3) 

S16 

PEELGRP 

GENMSL 

4:34 

000 

(4) 

All* 

BBULGB 

GENMSL 

17:49 

345 

(5) 

S16* 

PEELGRP 

UNKorMSL 

22.-07 

356 

(6) 

S29 

SNPTRl 

TOPBOW+2 

22:14 

029 

a) 

A19-22 

PUFFBALL 

UNK 

33:35 

278?  start 

(8) 

A44-46 

AS-2 

SSN2/AS2 

35.-00 

122?  start 

_ 

ENTRY  or 
DESKS  ID? 


*  Not  always  consistently;  smnetimes  these  are  di^layed  correctly. 

Significance:  In  the  scenario,  some  HOSTILE  onitters  are  initially  classified  by  the  OTD  as 
different  platforms.  This  check  is  an  indicator  diat  die  operator  recognizes  that 
these  pladbrms  are  in  fact  different  dian  diat  diqilayed.  [Of  additional  interest  is 
the  reastm  fcv  redesignating  the  PALM  FROND  to  a  Sl^FACE  platform,  since 
the  submarine  is  a  higher  priority  threat] 

RELATED  MOPS:  7. 11 

DATA  SOURCE:  DXUNIT 

SCORE: _ /16 

(2  points  if  Redesignated) 


5.  Is  a  quick  (SO-scomkI)  submarine  amtact  repmted?  (Y/N) 


Hatform 

Up 

Irg 

Y/N 

S29 

SNPTRl 

22:14 

029 

Significance:  There  is  a  "hidden"  contact  that  appears  during  the  initial  missile  launch  and  then 
goes  inactive  after  a  minute  (30  seomds  when  running  double-time).  Most 
q)eratt»s  might  not  catch  this  one.  Also  of  interest  here  is  to  determine  why  he 
missed  the  contact.. 

?  Was  the  speaker  OFF?  (check  ^1) 

?  Were  any  alerts  inhibited?  (check  #22) 

RELATED  MOPS:  10,  13.  16 

DATA  SOURCE:  VIDEOTAPE 

SCORE: _ /2 

(2  points  if  Reported) 


6a.  How  many  times  did  the  qrerator  listra  to  the  signal  using  SIGNAL  SELECT?  (  ) 

6b.  How  many  different  emitters  did  the  operator  listen  to?  (  ) 

Significance;  Audio  analysis  of  emitters  is  a  technique  reportedly  used  more  frequently  by  good, 
experienced  operators.  Then  again,  there  may  be  some  questitxi  about  the 
operatOT’s  performance  if  he  listens  to  the  same  emitter  rq)eatedly. 

RELATED  MOP:  5 

DATA  SOURCE:  DXUNIT 

SCORE: _ /2 

(2  points  if  >8,1  if  >5) 
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7.  How  many  times  did  the  operator  consult  the... 

A.  EOB  during  the  scenario?  (  ) 

B.  intel  during  the  scenario?  (  ) 

Significance:  These  axe  indicators  of  what  resources  (along  with  audio)  the  operator  uses  in 
(Hder  to  classify  emitters.  This  is  not  indicative  of  proficiency,  only  descriptive. 
Because  experienced  operators  may  rely  more  on  memory  and  less  on  printed 
EOBs  than  inexperien^  operators,  this  should  not  be  scored. 

RELATED  MOPS:  18,  23,  41 

DATA  SOURCE:  VIDEOTAPE 

SCORE: _ /  0 


8a.  Did  operate  recall  location  of  platforms  at  scenario  end?  (  / 10;  using  questions  1>9  and 

13  ftrom  the  Post* Watch  Brief) 

8b.  Did  the  operator  recall  emitter  activity  at  the  end  of  die  scenario?  (  /  3;  using  questions 

17*19  from  the  Post* Watch  Brief) 

Significance:  Although  these  may  not  direcdy  relate  to  operator  performance,  this  may  be 
indicative  of  die  operator’s  awareness  of  the  tactical  situation. 

RELATED  MOPS:  25.  32,  33,  34 

DATA  SOURCE:  POST-WATCH  BRIEF 

SCORE: _ /2 

(1  point  each  if  >  50%) 
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-  COMMUNICATIONS  • 


9.  How  much  time  did  it  take  to  repoft  HOSTILE  emitters? 


a.  Emitters  which 

are  easier  (the  OTD  classifies 

correctly): 

Platform 

Radar 

Time  Uo 

Bre 

(1) 

S17 

DONn 

3:41 

048 

(2) 

S16 

OWLSCH 

21:38 

356 

(3) 

A30/A31 

SSN2CMH 

22:53 

000 

(4) 

A15-17* 

DWNBEAT 

25:22 

293 

(5) 

A26-29* 

SHRTHRN 

28:00 

040  start 

(6) 

A55/A56* 

SSN-19 

30:30 

080  start 

(7) 

A42/43* 

AS4MH 

33:09 

120 

(8) 

A38/39* 

AS4MH 

34:31 

294 

b. 

Emitters  which 

are  more  difficult: 

Platform 

Radar 

Time  Up 

Bre 

(1) 

S16 

PLMFND 

3:15 

000 

(2) 

S16 

PEELGRP 

4:34 

000 

(3) 

All* 

BBULGB 

17:49 

345 

(4) 

S16* 

PEELGRP 

22:07 

356 

(5) 

S29 

SNPTRl 

22:14 

029 

(6) 

A19-22 

PUFFBALL 

33:35  278?  start 

(7) 

A44-46 

AS-2 

35:00  122?  start 

Hme  to 

Word  "Racket”  * 


Time  to 

Word  "Racket"  * 


*  One  or  more  don’t  come  up  consistently 

Significance:  This  item  (#9)  and  #1  seem  to  be  the  most  important  checks  of  operator 
proficiency.  It  would  be  interesting  to  see  if  it  takes  less  time  to  repOTt 
emittos  that  have  been  conectly  classified  by  the  SLQ  than  it  does  to  rqxnt 
emitters  incorrectly  classified.  Of  additional  interest  is  if  the  operator  reports 
to  the  TAO  first,  as  should  be  done.  Note  also  that  the  initial  word  "Racket"  is 
used  for  a  latency  measure  because  of  variable  rates  of  speech  among 
operators. 


RELATED  MOPS:  13,  16,  17 


DATA  SOURCE;  VIDEOTAPE 


SCORE: _ /30 

(2  points  for  each  <  45  seconds,  1  for  >  45  seconds) 
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10.  How  were  surface  fire  control  radars  handled? 

a.  Were  fire  ccmtrol  radars  reported  before  missile  launch?  (Y/N) 


b.  Was  an  emergency  racket  given  for  fire  orntrol  radar? 

(Y/N) 

Platform 

Radar 

Disnlaved 

Time  Uo 

Brg 

(1) 

S16 

OWLSCH 

OWLSCH 

21:38 

001 

(2) 

S16 

PEELGRP 

GEN  MSL 

22:07 

001 

Significance:  In  the  scenario,  two  fire  control  emitters  from  a  HOS  SUR  are  acquired  and 
displayed  as  a  HOS  SUR  and  a  GEN  MSL  immediately  before  the  platform 
launches  two  Styx  missiles.  Since  both  are  fire  control  radars,  and  dierefore 
indicators  of  impending  hostilities,  they  should  be  reported  quickly  and  as 
emergency  rackets. 

RELATED  MOPS:  13,  17 

DATA  SOURCE:  VIDEOTAPE 

SCORE: _ /4 

(1  point  for  each  "Y**) 


11.  Were  commercial  platforms  reported?  (Y/N) 


Platform 

Radar 

Displayed 

Time  Uo 

Brg 

(1) 

AlO 

RDR-IE 

UNK 

6:30 

220 

(2) 

S18 

Marconi 

CR1C5A 

17:30 

253 

(3) 

S28* 

Decca-40 

UNK 

34:25 

320 

*  This  does  not  come  up  consistently. 

Significance:  Whether  or  not  commercial  radars  are  reported  may  be  dependent  upon  the 
operator’s  previous  training  and/or  procedures  aboard  his  individual  ship.  This 
check  may  be  just  descriptive  of  the  EW’s  standard  operating  procedures. 

RELATED  MOPS:  12, 13 

DATA  SOURCE:  VIDEOTAPE 

SCORE: _ /2 

(1  point  for  each  "Y”) 
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JlLi. 


12.  Did  operator  give  a  "resume  racket"  reptnt  for  new  hostile  emittns  previously  acquired? 
(Y/N) 


Resume  Racket? 


Platform  Radar  Time  Up  1st  Time  Up  2nd  Brg  Y/N 

S16  PEELGRP  4:34  22:07  356  _ 

Significance:  In  the  scenario  one  UNK  emitter  goes  inactive  and  then  is  reacquired  later.  If  the 
operator  recognizes  that  the  reacquired  emitter  is  in  fact  the  same  emitter,  he 
should  pass  a  "resume  racket"  report. 

RELATED  MOPS:  13,  36 

DATA  SOURCE:  VIDEOTAPE 


SCORE: _ /  2 

(2  points  for  a  '*Y") 


13.  Were  hostile  mode  changes  reported?  (Y/N) 


Platform 

Radar 

Time 

Brg 

Y/N 

(1) 

All* 

BBULGB 

17:49 

345 

(2) 

A8* 

BBULGA 

20:30 

293 

_ 

Significance:  Mode  changes  on  HOS  airciaft  could  be  indications  that  ownship  is  being  targeted 
or  a  data  link  has  been  established.  This  information  is  useful,  and  maybe  even 
critical,  especially  to  TAO. 

*  NOTE:  These  seem  to  occur  in  the  Envirtmment  Generator  delivered  scenario. 
RELATED  MOPs:  13,  36 
DATA  SOURCE:  VIDEOTAPE 
SCORE: _ /O 

(2  Points  for  each  ’’Y",  1  Point  if  reported  as  a  new  radcet) 
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14.  Were  initial  chaff  launches  reported?  (Y/N) 


Against 

Platformfsl  Time  Up  Brg  Y/N 


(1) 

A30/A31 

SSN2C(Styx)  22:53 

000  _ 

(2) 

A55/A56* 

SSN-19  30:30 

080  start  _ 

(3) 

A42/43* 

AS4(Kitchen)  33:09 

120  _ 

(4) 

A38/39* 

AS4(Kitchen)  34:31 

294  _ 

(5) 

A44-46 

AS2  (Kipper)  35:00 

122?  start  _ 

*  One  or  more  of  these  don’t  come  up  consistently. 


Significance:  Reporting  chaff  launches  should  be  automatic  for  any  operator. 
RELATED  MOPs:  14,  28.  42 
DATA  SOURCE:  VIDEOTAPE 


SCORE: _ /5 

(1  point  for  each  ”¥”) 


15.  Was  the  number  of  missiles  launched  reported  correctly?  (Y/N) 


Against  (Correct 

Platform(s)  Comnosition 

Time  Uo 

Brg  Y/N 

Composition 
Not  Reoorted 

(1) 

SSN-2C  (Styx) 

2 

22:53 

000 

(2) 

SSN-19  ♦ 

2 

30:30 

080  _ 

(3) 

AS-4  (Kitchen)* 

2 

33:09 

120  _ 

(4) 

AS-4  (Kitchen)* 

2 

34:31 

294  _ 

(5) 

AS-2  (Kipper) 

3 

35:00 

122?? 

*  One  or  more  of  these  don’t  come  up  consistently. 

Significance:  As  the  missiles  in  the  scenario  undergo  mode  changes  (i.e.  "lock-on")  new  symbols 
for  the  missiles  are  displayed.  Until  the  operator  accesses  the  alert  box  around  the 
initial  missile  symbols  (now  inactive),  more  than  two  missile  symbols  are 
displayed.  Some  (^)erators  will  report  more  than  the  actual  number  of  missiles 
because  they  have  not  realized  that  the  missiles  have  undergone  mode  changes  and 
the  system  is  treating  them  as  new  emitters.  While  inaccurate  composition 
reporting  may  or  may  not  have  an  impact  on  tactical  responses,  this  item  is 
included  since  it  may  be  indicative  of  an  operator’s  understanding  of  the  system 
display  characteristics. 

RELATED  MOPS:  13,  17 

DATA  SOURCE:  VIDEOTAPE 

SCORE: _ / 10 

(2  points  for  each  "Y",  1  if  "N”  but  other  composition  is  reported,  0  for  Not  Reported) 


.  COUNTERMEASURES  - 


16.  Was  the  DECOY  STATUS  screen  accessed?  (Y/N) _ 

Significance:  This  is  indicative  of  the  operator's  attempt  to  remain  knowledgeable  and  current 
regarding  available  decoy  resources. 

RELATED  MOP;  42 

DATA  SOURCE:  DXUNIT 

SCORE:  NOT  SCORED 


17.  Did  operator  launch  chaff  against  a  missile  not  targeting  ownship?  (Y/N) _ 

Significance:  Operators  seem  to  initiate  chaff  launching  automatically  even  if  the  detected 
missile  is  not  an  actual  threat  to  ownship.  One  of  the  SSN-2Cs  is  not  targeted 
at  ownship;  therefore  if  the  operator  does  not  launch  chaff  in  response  to  this 
threat,  it  is  assumed  here  that  he  has  determined  that  ownship  is  not  targeted. 

Chaff 

Pifttfocm  fiig  Launched? 


RELATED  MOPs:  37, 42, 46 
DATA  SOURCE:  DX  UNIT 
SCORE: _ /2 

(2  points  if  "N”,  only  if  chaff  was  launched  against  other  missiles  listed  in  check  #18) 
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18.  Was  chaff  successfully  reseeded  to  counter  missiles?  (Y/N) 
(+  average  tune  in  seconds  to  reseed) 


Against 

Platform 

(1) 

SSN-2C 

(2) 

SSN-19* 

(3) 

AS-4* 

(4) 

AS-4* 

(5) 

AS-2 

#  Times 

Time  Launched 


Av  Time  Side  Used  Tubes 
to  Reseed  (PF/SF/BOTHl  Used 


*  One  or  more  of  these  don’t  come  up  consistently. 

Significance:  This  is  descriptive  of  an  q)erator’s  training/experience  in  chaff  launch  procedures. 

Some  operators  only  launch  one  round  per  missile  group,  others  have  been  seen 
to  reseed  the  chaff  at  abmit  thirty-second  intervals.  Note  that  several  operators  had 
attempted  to  launch  chaff  but  received  (for  one  reason  or  anotiier)  an  "Illegal 
Action"  notification  from  the  system. 


RELATED  MOPs:  30,  42 

DATA  SOURCE:  DX  UNIT/ VIDEOTAPE 


SCORE: _ /5 

(1  point  if  chaff  launched) 


19.  Did  operator  engage  targets  with  AECM?  (Y/N) 

Significance:  This  is  indicative  of  either  the  opmtor’s  familiarity  with  alternative  ASMD 
procedures  or  (more  likely)  his  familiarity  with  the  V(3)  system.  This  check 
should  be  compared  to  the  operatOT’s  SL(^32(V)  experience.  If  his  experience 
only  included  V(2)  then  an  ”N"  would  not  be  surprising.  If  his  experience 
included  V(3),  then  an  "N”  would  be  more  significant. 

EFX(s)in 

FAB  Used  Y/N  #  Times  Close  (Control 

(1)  ECM  Mode  _  _  _ 

(2)  ECM  Engage  _  _  _ 

(3)  ECM  Alternate  Engage  _  _  _ 

RELATED  MOP^:  44.  46 


DATA  SOURCE:  DX  UNIT 

SCORE: _ /  2  !!  DO  NOT  COUNT  IF  OPERATOR  IS  FROM  A  V(2)  PLATFORM  !! 

(2  points  if  used) 

20.  Did  operator  recommend  course  changes  and/or  EMCON  in  response  to  missiles?  (Y/N) 

Significance:  Operattn^  may  recommend  course  and/or  EMCON  changes.  Again,  this  is 
descriptive  of  the  operator’s  training/expeiience  in  countermeasures,  and  may 
reflect  more  on  procedures  aboard  individual  ships. 

Recommendation  If  so,  what  was 
Platform  Given?  (Y/N)  the  Recommendation? 

(1)  SSN-2C  _  _ 

(2)  SSN-19*  _  _ 

(3)  AS-4*  _  _ 

(4)  AS-4*  _  _ 

(5)  AS-2  _ _  _ 


*  One  or  more  of  these  don’t  come  up  consistendy. 

RELATED  MOPv.  9,  35 

DATA  SOURCE:  VIDEOTAPE 

SCORE: _ /lO 

(2  points  for  each  "Y") 
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.  SYSTEM  OPERATION  - 


Note  recommendation  that  the  checks  under  this  sut»ection  be  dropped  from  assessment 
(scoring)  and  retained  for  descriptive  data  only.  (E.g.,  see  comment  on  check  #24,  and  also 
because  there  seems  to  be  little  correlation  with  rest  of  subsections.) 

21.  Did  operator  turn  Speaker  OfT?  (Y/N) 

Significance:  The  speaker  gain  can  be  turned  down  to  inhibit  new  emitter  alerts.  An  operator 
who  turns  the  speaker  OFF  is  left  with  only  visual  cues  that  a  new  emitter  has 
been  acquired.  This  may  be  used  in  conjunction  with  other  checks,  such  as  #S, 
to  determine  why  an  operator  may  "miss"  some  hostile  emitters. 

RELATED  MOPs:  29 

DATA  SOURCE:  DX  UNIT 

SCORE: _ /  1 

(1  point  for  an  "N") 


22.  Did  the  operator  access  other  FABs:  (Y/N) 
FAB  Used  #  Times 


Significance;  Once  again,  this  is  useful  in  describing  how  well  the  operator  exercises/exploits 
the  SLQ-32  capabilities.  This  may  be  used  in  conjunction  with  other  checks  such 
as  #5  to  determine  why  an  operator  may  "miss"  some  hostile  emitters. 

RELATED  MOPS:  23,  29 

DATA  SOURCE:  DX  UNIT 

SCORE: _ /  1 

(1  points  if  other  FABs  accessed  -  Primarily  for  descriptive  purpose) 


23.  NEW  How  many  times  was  "ILLEGAL  ACTION"  displayed? _ 

Significance:  This  figure  represents  operations  attempted  on  the  SLQ  without  success  and  could 
indicate  errors  in  procedural  knowledge  of  the  operator. 


B-15 


24.  Were  inactive  emitter  symbols  retained  on  the  polar  display?  (Y/N) _ 

Significance:  One  operator  was  careful  to  HOOK  (instead  of  SEQ  to)  emitters  on  the  polar 
display  so  that  the  symbology  would  not  be  dropped  after  the  emitter  went 
inactive.  This  was  apparently  to  help  him  preserve  the  picture  of  the  tactical 
situation  and/or  keep  a  readily  available  history  of  previously  identified  emitters. 
Note  that  if  an  emitter  was  to  go  inactive  and  later  be  reacquired,  the  operator 
would  be  expected  to  give  a  "resume”  report. 

RELATED  MOPS:  25.  29 

DATA  SOURCE:  DX  UNIT/VIDEOTAPE 

SCORE: _ /  2 

(2  points  for  a  "Y") 


25.  Did  the  operator  attempt  to  clear  the  outer  ring  of  the  display?  (Y/N) 

Significance:  Some  operators  redesignate  known  hostile  emitters  as  either  friends  or  as  generic 
missiles  in  order  to  unclutter  or  clear  the  outer  ring  of  the  wagonwheel.  This 
check  is  one  descriptor  of  how  the  individual  operator  exploits  the  capabilities  of 
the  SLQ-32.  Note,  however,  that  these  are  not  approved  techniques  and  may  have 
detrimental  effects  on  system/operatcn^  performance.*  Therefore,  recommend 
revising  scoring  to  provide  only  descriptive  data  and  not  contribute  to  a  rating  of 
competency. 

RELATED  MOP:  29 

DATA  SOURCE:  DX  UNTT/VIDEOTAPE 

SCORE: _ /  0  (Note  that  score  has  dianged  to  "0".) 

*  Isn’t  recommended  because: 

(1)  SLQ  doesn’t  update  PRI,  Fieq,  etc.  of  emitters  which  are  designated  missiles 

(2)  of  system  integration  with  other  displays. 
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26.  Was  system  preempt/countertaigeting  used  <xi  (potential)  threat  bearings?  (Y/N) 

Significance:  If  threat  emitters  occur  or  are  likely  to  occur  on  certain  bearings,  operators  may 
establish  preeiiq)ts  in  anticipation  of  higher  threat  emitters. 

RELATED  MOP:  45 

DATA  SOURCE:  DX  UNnyVIDEOTAPE 

SCORE: _ /  2 

(2  points  for  a  "Y**) 


NEW  27.  Was  the  ESM  Inhibit  function  used  on  reoccuiring  emitters?  (Y/N) 

Significance:  In  the  scenario,  seme  emitters  (especially  those  operating  in  Band  1)  are  dropped 
and  then  reacquired  by  the  system  shortly  thereafter.  Likewise,  smne  air  tracks 
leave  multiple  symbols  on  the  display  as  they  "fly  by".  This  check  is  similar  to 
check  #25  in  that  it  represents  a  fast  technique  to  clear  such  emitters  fiom  the 
polar  display.  There  is  a  risk  in  using  this  FAB,  however,  in  that  alerts  for  new 
emitters  which  may  occur  at  the  time  may  be  cleared  from  the  display  as  welL 

RELATED  MOP:  29 

DATA  SOURCE:  DXUNIT 

SCORE:  _ /I 

(1  point  if  used) 


NEW  28.  Did  the  (^)erat(n'  manually  enter  scan  information  on  emitters?  (Y/N) 

Significance:  The  operator  has  the  cation  of  entering  scan  infinmation  on  an  emitter  in  close 
ccmtrol  by  pressing  the  ENTRY  FAB  and  entering  a  numeric  "3”.  The  scan 
infcmnation  can  be  derived  by  timing  the  scan  period  using  a  stop  watch.  Use  of 
this  feature  aids  in  rapid  identificatimi  of  emitters  and  implies  greater  familiarity 
with  system  fimctitHis. 

EMITTER  IN  SCAN 
CLOSE  CONTROL  ENTERED 


RELATED  MOP:  29 

DATA  SOURCE:  DX  UNIT 

SCORE: _ /  2 

(2  points  if  used) 
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